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CHAPTER 1 


SORTING AND SORTING NETWORKS 


1.1 Sorting 

The ability to sort a sequence of objects seems to be important in the 
solution of many data processing problems. This thesis deals with a particu- 
lar kind of sorting algorithm called a sorting network; but before discussing 
sorting networks, it will be appropriate to deal with sorting per se. 

Intuitively, to sort is to rearrange a sequence of "values" or "numbers" 
to conform to some order. There are always two orders involved in this 
process; the order implicit in the sequence and the numerical order of the 
values themselves. For example, if each of a sequence of locations in a 
computer memory contains a number, we can talk about sorting the sequence 
of numbers. This is done by changing the locations of the numbers so that 
after the process is completed, the number in location x is less than or 
equal to the number in location y whenever location x precedes location y. 
Note that sorting affects neither the sequence of the locations nor the 
values of the numbers. Rather, it changes the assignment of numbers to 
locations. Definition 1.1.1 generalizes these intuitive notions to deal 


with partially ordered sets. 


Definition 1.1.1 If D and R are sets partially ordered by P and <, respec- 


tively, and if f is a function from D to R, a permutation T on D sorts f 


(with respect to P) if 


(¥x, yED) (T(x) PM(y) > £(x) = fly)) 
or, equivalently, 


(x, yep) (xPy = £¢ 4 (x)) = eer hyyy) 


The function £ is called an assignment from the locations of D to the values 
of R. If £f is an assignment which is already sorted with respect to P, i.e. 


if f satisfies the condition 
(¥x, y€D)(xPy > f(x) S f(y)) 


then f is consistent with P. a 


Letting £-g denote the composition of the functions f and g, i.e. f+-g(x) = 
e(f(x)) for all x in the inverse image of the domain of g, it is easy to 


see that if T sorts f with respect to P, then i ee is consistent with P. 


Example 1.1.2 If D and R are the sets {a,b,c,d} and {0,1,2,3,4}, respec” 
tively, with P and < the obvious total orders, then the permutation (abd) (c) 


sorts the assignment f defined by f(a) = f(d) = 0, f(b) = 3, £f(c) 2 


2 


> 


with respect to P because e(7 (a)) = 0, fin (b)) = 0, tq (e)) 


ij 


aud f(m “tay) 2.3. 


Of course, the most usual special case of sorting arises when D is 
a finite set, P is atotal order, R is a set of numbers, and S is the 
familiar total order. If Dis not finite or if < is not total, it may 


not be possible to sort some kinds of assignments. 


Example 1.1.3 Let D and R both be the set of posttive integers, with P 


and S the obvious total orderings. The assignment f defined by 


O if n is even 
f(n) = 


1 if n is odd 


cannot be sorted because f(n) = 0 for infinitely many n, and therefore a 


permutation T to sort f could not have T(n) finite for n odd. 


Example 1.1.4 Let D and R both be finite sets, with P any partial order 
on D and $ the identity relation on R. Then no injective assignment f 
can be sorted unless P is the identity relation on D, for if xPy with 


x #yY, e(m 1 (x)) = g(t (y)) is false for every permutation T. 


It is clear that if D is finite and P and < are a total orders, any 
assignment from D to R can be sorted by an appropriate permutation. 


In fact, P need not be a total order, as the next theorem shows. 


Theorem 1.1.5 Let £ be any assignment from a finite set D to a range 
R, with P a partial order on D and < a total order on R. Then any 


assignment f: D ~~ R can be sorted with respect to P. 


Proof: Let T be a total order on D such that PS T, and let 7 sort f 


with respect to T. Then 


(Wx, yep) (xty = £7 h(x)) <= ect yy))) 


Since P © T, we have 


(Vx, y€D)(xPy > xTy) 


and 


(Wx, y€D)(xPy = £07 4 (x)) <= eer yy))) 


I] 


so 7 sorts f with respect to P. 


It will be assumed in what follows that D is a finite set and * is a total 
order. It will be useful to let R be some set of numbers, with < the 
familiar total ordering. R will be either a finite set of positive integers, 
the set of all positive integers, or the set of real numbers; most often, 
it will be unnecessary to state explicitly which of these sets R denotes. 
The domain D will usually be a set of numbers, or a set of letters where 
confusion might result from the use of numbers. 

It will also be useful to talk about sets containing all of the sorted 


assignments of a particular kind. 


Definition 1.1.6 If P is a partial order on the domain D, then the sets 


Ap» Ip» and Z5 are defined as follows: 


> 
i 


P {f: D7 R| (¥x, y€D) (xPy > f(x) < f(y)) 


fom 
] 


{f: D> Rlfé A, Af is injective} 


Z a ei ae) Sea Rlf € Ap A Range(f) = {0,1}} 


That is, Ap is the set of assignments consistent with P, I, is the set of 
injective (one-one) assignments consistent with P, and Z5 is the set of 


zero-one valued assignments consistent with P. The set of all assignments 


from D to R will be written A_; similarly, I_ denotes the set of all 


injective assignments from D to R, and Z_ will denote the set of all 
zero-one valued assignments from D to R. Thus I, = Ap n I_ and Zp = 


4p nz. 


1.2 Sorting Networks 

The familiar algorithms for sorting an assignment f make use of 
two primitive operations: comparison and interchange. For any pair 
of elements x and y in D, a comparison of x and y determines whether 
or not f(x) S f(y), and an interchange of x and y transforms f into 
f"' = n lve, where 7 is the permutation (xy). These two primitive 
operations are combined in the definition of a comparator which can be 
viewed as a kind of sorting operation gies two element domain. 
Specifically, a comparator on x and y performs an interchange of x 
and y if and only if the assignment f has f(x) > f(y). Notice that 
a comparator on x and y transforms an assignment f into an assignment 


f' satisfying f'(x) = f'(y), so that f£'(x) is the minimum of f(x) 


and f(y) and £'(y) is the maximum of f(x) and f(y). 


Definition 1.2.1 If x and y are elements of domain D, the comparator 


<x,y> is that operation which transforms any assignment f into the 


assignment f' = <x,y>(f) given by 
£ if f(x) < f(y) 
ft = 
=~] F 
TT ef if f(x) > £(y) 


where 7 is the permutation (xy). 
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A comparator <x,y> may be represented schematically by an arrow 
from x to y, indicating that the larger of f(x) and f(y) will be 
assigned to y and the smaller of f(x) and f(y) will be assigned to x. 
A composition of comparators can be drawn as a network, with locations 
in D represented by lines drawn from left to right and comparators 
represented by arrows connecting the lines vertically. For example, 


if D is the domain {a,b,c,d}, then the composition of comparators 
<a,b> * <d,c> *“a,d> °<b,c> ° “b,d> 


can be represented by any of the networks depicted in Figure 1,2.1 


oO & 


(a) 


a oo 


(b) 


(c) 


Figure 1.2.1 Examples of comparator networks. 


11 


In Figure 1.2.1, the horizontal lines (often called “wires" by analogy 
with electrical networks) are labeled with the elements of D that they 
represent. For any labeled network, there is exactly one composition 
of comparators that the network represents, and for any composition 

of comparators, there is exactly one labeled network (as long as 


rearranged versions of the same network do not count as distinct.) 


Definition 1.2.2 A comparator network is a composition of comparators. 
If £ is an assignment and C is a comparator network, C(f) will denote 
the assignment that f is transformed into by the composition of 
comparators C. If Ais a set of assignments, the image of A under a 


comparator network C is written C(A) and defined to be the set 


a 


(cceyle € A} 


Although a comparator network has been defined abstractly as a composition 
of functions called comparators, it is possible to implement a comparator 
as a finite state machine and thus to implement a comparator network as 

a network of finite state machines. This implementation is discussed 


more fully in Chapter 2. 


Definition 1.2.3 If C(A_) = Ap for some partial order P on D, then C is 
said to sort with respect to P. If T is a total order on D such that 
C(A_) = Ap, C is called a sorting network (with respect to De st Cris 
a sorting network with respect to T such that xTy for every comparator 


<x,y> in the network C, then C is called a standard form sorting network. © 


12 


For example, it can be shown that the comparator network described in 


Figure 1.2.1 is a sorting network; in fact, it is a standard form sorting 


network with respect to 


oaw wf 


It is conventional to draw comparator networks with no wire crossings 
and with the wire labeled x above the wire labeled y iff xTy. If this 
is done for a standard form sorting network, all of the arrows will point 
down, so that the arrowheads are redundant and may be omitted. Notice 
that Figure 1.2.1(b) observes these conventions. 


The next theorem is due to [Knuth]. 


Theorem 1.2.4. For any network C that sorts with respect to a total order 


T, there exists a standard form network C' that sorts with respect to T 


and contains the same number of comparators as C. mM 


When there is an implicit total order T on the domain D, it will be 
useful to extend the notion.of.standard form sorting networks and 
the conventions for drawing them to comparator networks in general 
by omitting the arrowheads when xTy for every comparator “<x,y> in the 
network. 

In what follows, the usual "higher is greater" convention for 
ordering diagrams of partial orders is inverted to conform to the 
eeavenessee for drawing standard form networks. That is, xPy iff x is 
connected to y by a path going downwards in the ordering diagram for 


the partial order. P. This causes the top-to-bottom arrangement of 
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domain elements to be the same for either the ordering diagram of a 
total order T or the wires of a standard form network that sorts with 


respect to T. 


Example 1.2.5 The standard form network 


at 


Q 


is a sorting network with respect to the total order 


Qo mb 


1.3 The Analysis Problem for Sorting Networks 


It is often quite difficult to decide whether a comparator network 
sorts. For example, it is difficult to verify by inspection that the 


standard form network of Figure 1.3.1 is in fact a sorting network. 


Figure 1.3.1 Sorting network. 
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This difficulty is reflected in the fact that S(n), the minimum number 

of comparators in any sorting network on an n-element domain, is unknown 
for n > 8; asymptotically, S(n) is known to be at worst Se A: but 
might be as small as O(nlogn) [Knuth]. Another manifestation of the 

same problem is that it is very difficult to design networks which are 
“sood'' in the sense that they contain as few comparators as possible; 

the only systematic design techniques known are based on recursive merges, 
and give rise to gies a growth rates in the number of comparators required 
[VanVoorhis]. 

There are at least two possible avenues to a better understanding of 
sorting networks. First, it would be useful to have better criteria for 
determining whether a comparator network is or is not a sorting network. 
In particular, a criterion which would lead to an improved upper or lower 
bound on the number of comparators in a sorting network would of course 
be very desirable. Second, better techniques for analyzing comparator 
networks are needed, since a more complete understanding of the capa- 
bilities and limitations of comparator networks in general would lead 
to a better picture of what is going on within sorting networks. 

This thesis explores these two avenues. Chapter 2 discusses two 
criteria, one of them new, for deciding whether a comparator network 
is a sorting network. Chapter 3 develops two related ways of charac- 
terizing the "state of the sort'’ in terms of sets of assignments that 


can appear as comparator network outputs. Chapter 4 explores the notion 


15 


of sorting with respect to a partial order. Finally, Chapter 5 contains 
a discussion of the results of the previous chapters and recommendations 


for further research in the area. 
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CHAPTER 2 


CRITERIA FOR DECIDING WHETHER A NETWORK SORTS 


2.1 Comparator Networks as Finite State Machines 


This section discusses an implementation of the comparator operation 
as a finite state machine. In this section, the term "comparator" will 
refer to the finite state machine implementation rather than to the opera~ 
tion itself, and the term "comparator network" will refer to the imple- 
mentation of a comparator network as a network of finite state machines. 
The term "assignment" will refer to an assignment with wires as the 
domain and sequences of binary digits as the range; each binary sequence 
implements the binary representation of an integer with the understanding 
that the most significant bit is first in the sequence. 

The state table for a comparator is shown in Figure 2.1.1. The 
Starting state is E, and as long as the upper and lower input symbols xy 


and X5 agree, the machine remains in state E. As soon as x, differs 


1 
from Xo» the machine enters state L or state G depending on which input 
digit is 0 and which is 1. State Lis entered if xy is 0, indicating 
0 1 
ara 
=D 
E 
x Zz 
7 Compar~ 1 L 
Xo ator Zo 
G 


Figure 2.1.1. Comparator state table. 
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that the integer represented on the upper input wire is less than the 
integer represented on the lower. In state L, Zz, = x) and Zn = Xo» 
thus leaving the assignment unchanged. State Gis entered if Xo is 0, 
indicating that the integer represented on the lower input wire is the 
smaller of the two; in state G, Zy = Xo and Z> =X, so that the outputs 
are the transposition of the inputs. If a new assignment is to be 
input to the comparator, the comparator must be reset to state E. 
Since a comparator network is a loop free interconnection of 
finite state machines, it is itself a finite state machine. A network 
containing k comparators has 3* states, some of which may be equiva- 
lent or unreachable from the starting state. It will be shown that 


a comparator network is a sorting network only if it contains a certain 


number of reachable states. 


Definition 2.1.1. Let C be a finite state machine, let f be any assign- 
ment, and suppose f takes the machine C from its starting state to 


State s. Then Cc, (g) will denote the output that results when the 


J 


assignment g is applied to C, starting in state s. 


The notation of Definition 2.1.1 is consistent with that of Definition 
1.2.2 under the convention that C(f) is just another way of writing 
c (f), where X% denotes the input sequence of zero length. (Since » 
leaves the machine C in its starting state, CG (£) is the output that 


results when f is applied to C in its starting state.) 


SSS ea 
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Definition 2.1.2 For any finite state machine C, let 8 denote the binary 


relation on input sequences defined by 


Ey atti Ne) (6, te) = Ce te) mM 


The relation = is an equivalence relation called the Nerode equivalence 
relation of C. It is a well-known result in automata theory that the 
blocks of the partition induced by =, on the set of all input sequences 
are in one to one correspondence with the reachable states of any reduced 
machine equivalent to C. 

The following theorem is a variation of Bouricius's theorem 


[Knuth]. 


Theorem 2.1.3 Let f and f, be assignments on domain D and let C be 


any comparator network on D with c(f,) - fy and C(£,) = fy. If 


, yD) (£1 (4%) < £,(y) = £y(«) < £,(y)) 
then 


(¥x, y€D) (£5 (&) < £5) => £4 (x) < £,(y)) 


That is, if f, is an order-homomorph of fy then c(f,) is an order-homomorph 


of C(f£,). 
Proof: The proof is by induction on the number of comparators in C. 


Basis: If C has no comparators, f, = f1 and f, = £4 so the statement 


1 1 2 2 


of the theorem is obviously true. 
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Induction step: Let the statement of the theorem be true for all networks 
containing n or fewer comparators, and let C' be a network of n+l compara- 
tors. C' can be viewed as the composition of a network C of n comparators 
and a single comparator <a,b>. Let fy and f, be any two assignments on D 
with c(f,) = f) and C(£,) = f}, and suppose that 


¥: < < 
(Vx, yeD)(£, (x) S £,(y) > £, (x) = £,(y)). 

Since C has n comparators, the induction hypothesis guarantees that 
(Yx, yeD) (£41 (x) S$ £1(y) = £4) S Eh (y)). 


Letting <a ,b>(f4) = fy and <a, b> (£5) = Es it is clear that fi = fy and 


' Lon t < ' ' t ' <r 

fy f as long as f, (a) £,(b). Tf £, (a) > f(b), then £,(b) fj (a) 
' ' to welt ON ' moo =1- ' 

and £5 (b) < f(a), so that fy = 1 fy and fy S10 fy where T is the 


permutation (ab). In any event, 


(Yx, yeD) (f(x) = f}Gy) = fh) < F5(y)). 


Corollary 2.1.4 If fy and f, are order-isomorphic assignments on D, i.e. 
if 


(Vx, yeD)(£, (x) < £,(y) © f(x) = £,(y)) 


then for any comparator network C on D, f, and f, leave every comparator 


1 


of C in the same state. 
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Proof: For any comparator <a,b> in C, apply the theorem to the portion 


of the network to the left of <a,b>. 


appear at the input of “<a,b> when C is applied to f 


satisfy 


It is easy 


so that fi 


Definition 2.1.5 


That is, f 


The assignments f/ and fy that 


£i(a) < £1(b) * £3(@) < £506) 


to verify that 


fi (a) < £,() © 


£, (a) 


£, (a) > £,(b) © 


£1(b) # 


f, (a) 
£5 (a) 


£4 (a) 


< 


u 


> 


£4 (b) 
£5 (b) 


£,(b) 


and fy leave <a,b> in the same state. 


1 


1 
and f,> respectively, 


Let = denote the binary relation on A_ defined by 


£, = £, # (Vx, y€D)(£, (x) < £,(y) © £,(x) < £,(y)) 


= f. iff f 


1 1 


and f, are order isomorphic. 


The binary relation = is an equivalence relation on A_ whose equivalence 


classes (order isomorphism classes) form a partition of A_- It will be 


useful to represent each block of the partition by a particular element 


of the blo 


Definition 2.1.6 


ck. 


8 is defined as follows: 


That is, P(x) is the number of values f(z) in the range of f that are less 


than f(x). 


£ (x) = I{£(z)le(z) < £(x)}| 


For every assignment f on the domain D the assignment 


0 
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Example 2.1.7 If £ is the assignment on D = {a,b,c,d} defined by f(a) = 3, 
A A 
f(b) = 4, and f(c) = f(d) = 1, then f is the assignment defined by f(a) = 


ay] =1, Po) = Irt,37! = 2, and Fe) = Pea) = Il = 0. n 


A 
Theorem 2.1.8 For any assignment f in A_, f = f. 


Proof: Suppose f(x) S f(y). Then 
(£(z)lecz) = E(x} © (£(z)l£(2z) < £Cy)) 
so B(x) = Py). Now suppose f(x) < f(y) is false, so that f(x) > f(y); then 


(£(z)l£(z) <E(y)) © (£2) lez) < £(x)} 


A A A A 
and £(x) > F(y), so f(x) S$ f(y) is false. a 
Theorem 2.1.9 For any two assignments f, and f, in A £25 6Ep0 7 p = e 
Scot rename y 1 2 =? 1 2 1 2° 
Proof: Let fy = fy. Then for all x, £, (2) < £, (x) Lff £, (2) < £, (x) and 
£,(z) = £,(2') iff £,(2) = £,(2'), from which it follows that Ie, (2) lf, (@) 
A A 

= = mM 

< £,(x)}! Ire (z)l€, (2) < £,(%))! and ee 


Theorems 2.1.8 and 2.1.9 imply that every block of the partition of 


A 
A_ induced by = contains exactly one assignment of the form f. It will 


now be argued that if C is a sorting network, Te is the same equivalence 


relation as =. 
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Theorem 2.1.10 If C is a sorting network on an n-element domain D, 


then for all assignments £,..and £, in A; :f, =. f, ° ft, =f 


1 2 loc 2 1 2.5 
Proof: In view of Corollary 2.1.4, fy = f, > fy = f. If fy = fy, 
then since fy = cf and f, = ys fy a. . and f, ie ae i.e. f a ae 
Since an = e implies fy = Eas it remains to show that a a is implies 
. = Eee It will be convenient to let the domain D be the set [0,1,2,... 
nel}. 
Let e # om so that Bw # Bi) for some i. The set 


(min(e, (4), PIB, a) # 2) 
is nonempty; let j be such that min(F, (4), Ea) is the least element of 
this set and £4) # £,(4)3 without loss of generality, let EG) < PG). 
Let k denote the number of locations i in D such that ae® < eG), and 


define the function ¢ as follows: 


0: if i= 4 
(i) 


i+l otherwise 


Now consider CA (g) =h It will be argued that hy (k) = 0 
1 


1 and CA (g) =h 
2 


> 
and h, (k) #0. First, since there are k locations i with 2G) less than 


; A i 1 
fi). c(f,) = 


sorting network. Evicently, hy (k) is the smallest of the values g(i) such 


Kops 5 
is an assignment with Bt (k) = £,@) because C is a 


A A 
that £, G4) = £,(j)3 since g(j) is the smallest possible such value, hy (ke) = 


@(j) = 0. 
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Now consider h, (k). he (k) = 0 only if there are exactly k locations 
i with 2, (i) < £4). But since e@) = 2, (4) for every i such that 
BG) < iateD by definition of j, there are exactly k locations i such 
(j). This implies that for no location i is it the case 
(i) < Es In particular, there can be no location i 
9 (i) = 9 (9)-1. Since £5) is the number of elements in the set 
{£,(2)[£, (2) < fj); this is a contradiction. Therefore hy (k) # O and 
hy # hos implying B co iz is false. 


Example 2.1,11 This example illustrates the proof of Theorem 2.1,10. The 


A A A _ Ad A _ A 7 : 
assignments fi> oe c(t) = E> c(f,) = Eo. g, hy» and hy are given in the 


table below. 
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First, notice that the smallest element of (min(F, (4), COD ILSECD # 

f (4)] is 1; since £0) = 1 and (5) = 3, set j = 5. (The function g 
given in the table was chosen for this location j, although j = 0 would 
have worked equally well.) Since ea) < £6) for i = 1,4, and 7, 

set k = 3. Notice that h, @) = 0 because g (5) = 0, but because fi) < 
£6) for 7 locations i and 7 is greater than 3, h, (3) # 0; in fact, 


h, (7) = 0. 


Corollary 2.1.12 No two reachable states in a sorting network C are 


equivalent. 


Proof: Suppose fy and fy leave C in equivalent states, so that 


Ml 


f=. E 


1c Fai by Theorem 2,1.10, f, £4; finally by Corollary 2.1.4, fy and 


fo leave C in the same state. 


Corollary 2.1.13 A sorting network C on an n-element domain has 


reachable states, where (2 denotes a Stirling number of the second kind. 


Proof: It suffices to count the number of distinct functions of the form 
e for a domain of n elements. In fact, the number of functions f is 
equal to the number of totally ordered partitions on an n element domain D. 
To see this, let ~ be such a partition, totally ordered by T, and for 


A 
any element xD let f(x) be the number of blocks of » that are T-less than 
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the block containing x. It is not hard to verify that there is precisely 
one ordered partition corresponding to a given p and vice versa. Since 
(3 is the number of unordered partitions of an n element set containing 
k blocks, and since there are k! ways of ordering every such partition, 
o(n) is the number of totally ordered partitions on an n element domain 


A 
and hence the number of functions of the form f. 


It can also be shown that any comparator network that has O(n) 
reachable states has the property that the reachable submachine of 
the network is isomorphic to the reachable submachine of a sorting 


network with respect to state transitions. 


2.2. The Zero-one Principle 

Where as it might be thought that some comparator network could 
successfully sort all zero-one valued assignments and yet fail to 
sort a more "complex" assignment, this cannot in fact occur; Theorem 
2.2.1 shows that a test to see if all zero-one valued assignments are 


sorted by the network is conclusive. A proof may be found in [Knuth]. 


Theorem 2.2.1 (zero-one principle) A comparator network sorts every 


assignment in A_ if it sorts every assignment in Z. 


The zero one principle is very useful for deciding whether or not 


a comparator network sorts, 
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It is the purpose of this section to explore the question "for 


which subsets of Z_ do there exist comparator networks that sort 
precisely the assignments in those subsets". For example, it is 
possible for a comparator network to sort every zerom~one valued 
assignment but one? ‘the answer is yes. To prove this, a lemma 


will be needed. The proof is straightforward. 


Lemma 2.2.2 The network N depicted below sorts every element of Z_ 


0 0 0 

: 1 1 _ 1 
except the assignment 0? and N 0 = 9° 

1 1 1 


Now for the theorem itself. 


Theorem 2.2.3 If g is any assignment in Za except the constant zero 
or constant one functions, there exists a comparator network which 


sorts every element of Z_ except g with respect to.some total order T. 


Proof: Let the domain D be the set {0,1,2,...n-1}, and let g be 


an assignment on D of the form 
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m 
locations 
(0 to m=-1) 


n-m-2 
locations 
(m+2 to n-1) |: 

1 


a ot Kolo ke 


where 0 Sm <Sn-2. Now let g be applied to the standard form network C shown 
below. The boxes marked "SORT" are sorting networks, and the boxes marked 


"N" are networks of the kind shown in Lemma 2.2.2. 


It is easy to verify that C(g) = g is not sorted with respect to *%. 
Now let h # g be any other assignment in Z_- If h is applied to C, then 


at least one of the following four things must be true: 
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1. There is at least one 1 on input wires 0 through me1; 
2. There is a 0 on input wire m; 
3. There is a 1 on input wire mtl; 


4. There is at least one O on input wires m+2 through nel. 


In any event, the leftmost pair of sorting networks in C transform h into 


an assignment such that the leftmost N network in C does not receive the 
0 


pattern at its inputs. It follows from Lemma 2.2.2 that whatever 
1 


this assignment may be, it is transformed by the leftmost N network 
into an assignment which is sorted on the wires m-1, m, mt+1, and m+2; 
in particular, it cannot be the case that wires m and m+l are assigned 


1 and 0, respectively, at the output of the leftmost N network. This 
0 


means chat ; cannot appear at the inputs of the next N network in C, 


1 


or, inductively, at the input of any subsequent N network in C. In 
fact, every N network in C could be replaced by a four input standard 
form sorting network with no effect on the ultimate network output 
C(h). After this has been done, it is not hard to see that C(h) is 


sorted with respect to <; just verify that each iteration of the form 
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decreases the distance between the uppermost one and the lowermost zero 

by at least one in propagating the assignment, and use the fact that 

there are n such iterations in C. For the degenerate cases m = O and 

m =n-2, it will be necessary to remove the top (respectively bottom) 

wire from every N network together with all comparators touching that wire. 
Now let g' be an arbitrary nonconstant assignment in Z sy end “Lea ™ 


be a permutation on D such that = Teo! is an assignment of the form 
p g g g 


0) 

i : 
locations : 
0) 

1 

0 

1 

nem=2 ; 
locations |. 
1 


If C denotes the network that sorts every member of Z_ except g, let c' 
denote the network obtained by replacing every comparator <x,y> in C 
by the comparator <7(x), ™(y)>. Since g(x) < g(y) iff g'("(x)) < g'((y)), 
C' sorts every assignment in Z_ with respect to the total order T that 
satisfies 

(Yx, yD) (T(x)IT(y) @ x < y) 
i.e. the total order defined by 

(Yu, veED)(uTv © wo) s whey) 


but fails to sort the assignment g’. 
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An example will be useful to clarify the construction of Theorem 


2.2.3. 


Example 2.2.4. It is desired to construct a network which sorts every 


assignment but the assignment g' on D = {0,1,2,3,4} defined by 


) if x =3 
g'(x) = 
1 otherwise 


Now the network C shown below 


FP Ww NY Ff CO 


sorts every assignment but g, where g is defined by 


O if x=l1 
g(x) = 


1 otherwise 


(Notice that since there is only one wire for which g(x) = 0, the top 
wire of the network N has been removed together with all comparators 


touching that wire.) 


Since 7 = (13) is a permutation such that g = T*g', the network C' 


shown below 
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FP BW NY YF © 


sorts every element of Z_ except g' with respect to 


A 
iH 
Ff RP BM WwW OS 


Corollary 2.2.5 In verifying that an n-input comparator network sorts 
by means of the zero-one principle, it is necessary to try 2 a2 inputs, 


namely all the nonconstant zero-one valued assignments. 


Theorem 2.2.3 could be modifed to deal with standard form networks, 
which of course must sort at least those zero-one valued assignments 
that are already sorted. 

Among other things, Theorem 2.2.3 indicates that all nontrivial 
Statements of the form "any comparator network that sorts every element 
of this set of zero-one valued assignments also sorts that zero-one 
valued assignment" are false. The next theorem, analogously, denies 


the possibility of similar statements about assignments not sorted. 
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Theorem 2.2,6 For any zero-one valued assignment g, there exists 
a total order T and a comparator network C which sorts only that 


assignment (and the two constant assignments) with respect to T. 


Proof: Let g be an assignment on D = {0,1,2,...n-1} of the form 


0 

0 

= 0 
locations : 
0 

1 

1 

n=-m 1 
locations |: 
1 


where 0 =m<n. Now let g be applied to the network C shown below. 
The boxes marked "REV SORT" are sorting networks which sort in reverse, 


i.e. with respect to the total order 2. 


g=l 


Clearly c(g) = g is sorted with respect to <, as are the constant zero 
and constant one assignments, but no other assignment in Z_ is sorted 


with respect to =. Now let g' be any assignment in Z_, and let ™ bea 
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permutation on D such that g = T-g' is an assignment of the form 


m 
locations 


n=m 
locations 


mice emt ee Ors OOO 


A transformation of the comparators in C analogous to that performed in 


Theorem 2.2.3 establishes the theorem. 


There are certainly some sets of zero~one valued assignments for 
which there can be no comparator network sorting exactly the members 


of that set. 


Example 2.2.5 No comparator network containing one or more comparators 


can sort each of the assignments. 


0 0 0 1 


ene 
. 

eee 
eee 


a? i) 


« 
vy 


without sorting some other assignment. 
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Proof: The leftmost comparator in the network will receive a zero at 
one input and a one at the other for some assignment in the List. 

The assignment which results in the opposite arrangement of the zero 
and the one at the leftmost comparator input must also be sorted, but 
it is not in the list because interchanging a zero and a one in any 


assignment in the list will result in an assignment not in the list. 
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CHAPTER 3 


COMPARATOR NETWORK OUTPUT BEHAVIOR 


3.1 Output Characterizations 

The set of assignments that can appear at the output of a comparator 
network is sufficient to determine which networks can be concatenated to 
the network to make the combination a sorting network. Thus it is often 
useful to know the assignments that can appear at the output of a given 
comparator network. To the extent that sets of output assignments can be 
represented succinctly and manipulated easily, the problems of designing 
and analyzing sorting networks will become easier. In this chapter, two 
different kinds of assignments will be considered: injective assignments 
and zero-one valued assignments. These two kinds of assignments are related 


by the notion of threshold. 


Definition 3.1.1 If f is any assignment from D to R then 8(f), the set 


of thresholds of f, is defined by 
8(f£) = {g:D 4 (0,13 | (ar € R)(¥x € D) 


(g(x) = 1 iff r S f(x)} 
If A is any set of assignments from D to R, then 


6(A) = U 8(£) 
£EA 


— -—_ eee 
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Example 3.1.2 The set of thresholds of the assignment f: {a,b,c,d} 74 
{0,1,2,3} defined by f(a) = 0, £(b) = f(c) = 1, £(d) = 2 is the set 


(8g» 81> Bo» Ba). where the functions 8, are given in the table below. 


x £ (x) Bo (x) 8, (x) By (x) By (x) 


a 0 1 0 0 0 
b 1 i 1 0 0 
c 1 L 1 0 0 
d 2 1 1 1 0 m 


Notice that an assignment f is sorted iff all of its thresholds are sorted. 


The following theorem is a close relative of the zero-one principle. 
Theorem 3.1.3 For any network C and any assignment f, C(8(f)) = 9(C(£)). 


Proof: Let g' € c(8(f)), so that g' = C(g) for some g € O(f). Since 

f(x) = f(y) > g(x) S g(y) for all x and y, Theorem 2.1.3 guarantees that 
E'(x) < £'(y) > g'(x) < g'(y). If g'(x) = 0 for all x, certainly g’ € 9(f'); 
otherwise, set 


1 


r' = min {f£'(x)le'(x) =} 
x€D 


and let z be any element of D for which f'(z) = r', hence for which g'(z) = l. 
Now for all x, if r' s f'(x), i.e. if f'(z) < £'(x), then 1 = g'(z) Ss g'(x) 
and g'(x) = 1. Conversely, if g'(x) = 1, then r' s f£'(x) by definition of r'. 
It follows that g' € ®(f£'), and so C(®(f)) © 8(C(£)). Now, every element g 
in 9(£) is characterized uniquely by the number of elements in D mapped to 
zero by g. Since C merely permutes the domain of each g € 8(f), lccact))| = 


lacey! since C applied to f just permutes the domain of f, leccc£))| = 
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lece)!. Hence c(8(£)) = 8(C(£)). = 
The following corollary illustrates the use of Theorem 3.1.3. 


Corollary 3.1.4 For any two networks C and C', the following statements 


are equivalent: 


1. cC' sorts every assignment in C(Z_), the set of zero-one valued assign- 
¥ _/» 


ments that can appear at the output of C. 
2. C concatenated with C' is a sorting network. 


3. C' sorts every assignment in C(I_), the set of injective assignments 


that can appear at the output of C. 


Proof: 1 implies 2 because of the zero-one principle, and 2 implies 3 by 
virtue of the definition of a sorting network. It remains to show that 

3 implies 1. Let g' be any zero-one valued assignment that can appear 

at the output of C. Then e' = C(g) for some g. Now, g € 8(f) for some 
injective assignment f; letting c(f) = f', g' € 8¢f') by Theorem 3.1.3. 
Since C' sorts every injective assignment in C(I_), C'(f') is sorted 


and so is every element of 86(C'(f')). Since @(C'(f£')) = C'(8(E')), every 


i 


element of 8(f') (including g') is sorted by C'. L 


Corollary 3.1.4 guarantees that either the zero-one valued output 


assignments C(Z_) or the injective c'lput assignments C(I_) adequately 
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characterize a network C for purposes of designing a network C' so that 
C concatenated with C' is a sorting network. On the other hand, if the 
network C' is given and it is desired to design a network C so that C 
concatenated with C' is a sorting network, then the network C' is 
characterized for this purpose by those assignments that it sorts. 

In the light of Theorem 3.1.3, it is not surprising that the zero-one 
valued assignments sorted by C' characterize ene injective assignments 


sorted by C'. 


Theorem 3.1.5 If I is the set of injective assignments sorted by the 


network C' then for every injective f, 9(f) © ®(I) >f EI. 


Proof: Let 9(f) S 8(I) with f ¢ I. Then f' 


i 


C'(£) is not sorted, 

so there is a zero-one valued assignment g' ¢ 9(f') which is not sorted. 
Since g' € 8(C'(£)), g' € C'(@(£)) and so g' = C'(g) for some g € 9(f). 
Since @(f) © 8(I), there exists an injective h in I with g € ®(h). Since 
h € I, C'(h) is sorted and therefore every element of 6(C'(h)) is sorted. 


This implies g' € C'(®(h)) is sorted, a contradiction. Oo 


The example below shows that C' may in fact have to sort more injective 
assignments than those in C(I_) if C concatenated with C' is to be a 


sorting network. 


Example 3.1.6 The network 
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transforms the set I_ of injective assignments with range {1,2,3,4! 


into the set 


1 2 1 
C(I) es 2b 2: 
- 3 3 4 
4, 4, 3 
and transforms Z_ into the set 
0 0 0 0 01 21 
c(Z_) ! 0 0 0 01 0 i121 
0 01 21 1 21 21 
Oust. 0. 
2 
Since 8 ; S C(Z_) and since any comparator network C' that sorts 
3 
every element of C(I_) must also sort every element of C(Z_), such a 
2 
; 1 
network C' sorts ie? 
3 


This example suggests that zero~-one valued assignments may be more 
useful than injective assignments for output representation. This 
hypothesis will be reinforced by the results of section 3.4; the next 
two sections will be devoted to a more detailed examination of the 


properties of these two kinds of output assignments. 


3.2. Zero-one valued output assignment. 


Any set Z of zero-one valued assignments can be described by its 


characteristic function, which in turn can be described by a Boolean 
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expression. For convenience, let the domain of the assignments be 


D= {0,1,...n-1}. 


Definition 3.2.1 If 2 © Z_is a set of zero-one valued assignments on 
domain D = {0,1,...n-1), then the characteristic function of Z is the 
function k from Z_ to {0,1} defined by 

1 if eg €2Z 


k(g) = 
O if g €Z 


: nh F . : : 2 
Since there are 2° assignments g in Z_, each of which is a function 
from D to {0,1}, it is possible to represent a characteristic function k 
by a Karnaugh map or a Boolean expression in the n variables Xoo Kyo eee 


n-L' For example, the network 


Ww NF © 


has the set of output assignments C(Z_) described by the table below. 


The Karnaugh map for the characteristic function of C(Z_) is 
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and this function can be described by the expression Xo%1 + XOX) + Xo X3 


+ X1Xo%3- In this fashion, a Boolean expression can describe any set of 


zero~one valued assignments, and in particular, the set of zero-one 
valued outputs £(Z_) of a comparator network C. 

A comparator “i,j> concatenated to the output of a network C results 
in a new network C' = C-“<i,j>, a new set of zero-one valued output assign= 
ments C'(Z_) and hence a new characteristic function described by a new 
expression. The following definition will be useful in describing this 


phenomenon. 


Definition 3.2.2 If E is a Boolean expression in the variables KqeXpoees 


x then E/ is the expression obtained by replacing every 


n=l’ 


(x5 55) 


occurence of x, in E by x, and every occurence of x, in E by Xe 0 


j 


The theorem below describes the effect of a comparator <i,j> 
on a set Z of zero-one valued assignments. This is done by giving an 
A 
expression E for the characteristic function of <i,j> (Z) in terms of i,j, 


and any expression E for the characteristic function of Z. 
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Theorem 3.2.3 Tf Z is a set of zero-one valued assignments on the 
domain D = {0,1,...n-1! and E is a Boolean expression for the charac~ 
teristic function of Z in the variables XgoXporre ok ye then the 
comparator <i,j> transforms Z into a set whose characteristic function 


A 
is described by the expression E, where 


A Ex! + E/ 
= Hx! an > aoe 
L (x5 55) J 


Proof: Every assignment g € Z can be classified as to whether g(i) = 0 


or g(i) = 1. Let Zo and Zs partition Z according to eg(i): 


Zy = (8 © 2le(a) = 0) 
z, ={g € 2le(i) = 11 
and let Ey be the expression Ex; and Ey the expression Ex, + Eo is an 


expression for the characteristic function of Z because g € Zo iff 


g € Z and g(i) = 0; similarly, E, is an expression for the characteristic 


1 


function of Zy° Since Z = Zo U Zy> the expression Eo + Ey is an expression 


for the characteristic function of Z; moreover, the effect of the compara- 


tor <i,j> on Z can be determined by its effects on Zo and Z In parti-~ 


1° 


cular, the comparator has no effect on Z since g(i) = 0 for every 


0? 
g & Zo> but the comparator interchanges the values of g(i) and ¢g(4) for 


every g € zy since g(i) = 1 for these g. It follows that 
Ex, + CEx,)/ 


ok 5) - i L G5 ox ,) 


or 


> 
i 
Fe 
- 
ies] 
~ 


43 


is an expression for the characteristic function of the set <i,j> (Z). fa 


Since convenient representations for sets of zero~one valued assignments 


are desirable, let us explore representations for Boolean expressions. 
The product of sums form for expressions seems to be most useful because 
it provides a convenient way of representing the kinds of statements 
used to describe consistency. First, a theorem about the form of any 


product of sums expression for a set of output assignments. 


Theorem 3.2.4 If C is any comparator network and E is any product of 
sums expression for the characteristic function of C(Z_), then every 
factor in E must contain at least one complemented variable and at 


least one uncomplemented variable. 


Proof: It is clear that C(Z_) must contain both the constant zero 
assignment (the assignment that is zero for every location in D) and 
the constant one assignment. Now suppose some factor in E contains 
no complemented variable. Then the constant zero assignment could 
not appear in c(Z_), a contradiction. Similarly, every factor in 

E must contain an uncomplemented variable if the constant one assign~ 


ment is to appear in C(Z_). m 


Corollary 3.2.5 The set of zero-one valued output assignments C(Z_) 
for any comparator network C has a chsracteristic function which can 


be described by an expression of the form 
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E = i Gar sep)" a » x)! 


k=1 fA, jcB, 


ie 


F th : 
Proof: Write the k factor in a product of sums form for E as sea, tate 


i 
ita, 
ee 
* 3 theorem 3.2.4 guarantees that the sets A. and By are nonempty. 
je B 


The result then follows from DeMorgan's law. 
When the set C(Z_) of zero-one valued output assignments consists 
precisely of those assignments consistent with a certain partial order 


P, then a particularly simple form for E is possible, based on the 


covering relation for P. 


Definition 3.2.6 If P is a partial order on D, then the covering 


relation for P is the relation P on D defined by 


iPj @ iP] A id} A (Wk) 


((4Pk A kPj) = (k=i V k=j)) 


The covering relation P for a partial order P is irreflexive, 
antisymmetric, and intransitive, and any irreflexive, antisymmetric, 
and intransitive relation P is the covering relation for some partial 


order P (namely the reflexive transitive closure of Dy 
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Theorem 3.2.7 Let C be a comparator network. The characteristic function 


for C(Z_) has an expression of the form 


E- = | | i +x) 


(i,j)€P 
where P is irreflexive, antisymmetric, and intransitive, if and only if 


C(Z_) =Z_ for some partial order P with P the covering relation for P. 


P 


Proof: It will be shown that for any partial order P, ES is an expression 


for the characteristic function of Z,; since every partial order has a 


Pp? 
unique covering relation and every irreflexive, antisymmetric, intransitive 
relation is the covering relation for some partial order, this will 


prove the theorem. So let P be a partial order on D, with P the covering 


relation for P, and suppose g ¢€ Z Then iPj = g(i) < g(j), and since 


Pp 
P&P, iPj = g(i) $ g(}). This means that g(i) = 0 or g(j) = 1 for all 
ordered pairs (i,j) ¢ P, so that the expression ES evaluates to 1 (the 
characteristic function evaluates to 1) for g. Now suppose ES evaluates 
to 1 for some g ¢ Z_, so that g(i) = 0 or g(j) = 1 for all (i,j) € P. 

This means that iPj = g(i) < g(j). Now let iPj. Since P is the reflexive 
transitive closure of P, either i=j, and g(i) < g(j), or there exists a 


chain i = Ag r4y sneer = j in P with agPa,; a,Pays+++a_4Pa_. In the 


latter case it follows that 8 (aq) s g(a,) < g(a,) <... 8 g(a), so 


that g(i) < g(j). Having shown that iPj = g(i) = g(j), we conclude 


that ¢ € Zy: m 
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Theorem 3.2.8 provides a generalization of Theorem 3.2.7. 


Theorem 3.2.8 Let C be a comparator network on D, and let R © DXD be 
a binary relation such that 

E, = Fe be ae a 

Gaye. be 
is an expression for the characteristic function of C(Z_). Then there 
exists an irreflexive, antisymmetric, and intransitive relation RGR 
such that 


Es = | | (x; ted 


(i, jER 
is also an expression for the characteristic function of C(Z_). 


Proof: It will be shown that R is antisymmetric. Given this fact, it 
will be possible to show that R, the "irreflexive intransitive part” of 


R, satisfies the conditions of the theorem. To show that R must be 


antisymmetric, assume (x, + x;) and (x; + x,) both occur in Eps and 
consider an injective assignment f in C(I_). Because of the symmetry 
between x; and x, no generality is lost by letting f(i) < £(j); this 
implies the existence of a zero-one valued assignment g € 8(f) with 
g(i) = 0 and g(j) = 1. Since g ¢ 8(f), g € C(Z_) by Theorem 3.1.3. 
But Ep evaluates to O for g because x; ees evaluates to 0, a contra- 


diction. 
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Now let R be defined by 


R = {((i,j)€R! if; A 


(Wk) (ARK A kRJ) > (k=i V k=j))} 


R is irreflexive and intransitive by construction, and antisymmetric 


because R is antisymmetric. The only factors in ER that are not in 


R are either of the form (xs + x), which is equivalent to 1, or of 
the form (! +%,), with factors of the form (x,' +x ), (x' +x ).. 
i j i ay ay 9 


(x, +x.) all appearing in Es (and Ep). In either case, it is easy 


r 
to see that omission of these factors from ER does not change the 


characteristic function described by E,, so ES and ER describe the same 


characteristic function. 


There exist algorithms ([Miller] pp150-175, for example) which 
reduce an expression E to minimal product of sums (or sum of products) 
form. Here "minimal" means that any other equivalent expression contains 
at least as many literals as does the minimal one. Such a minimum 
expression affords a fairly compact representation for the zero-one 
valued outputs of a comparator network, especially when the conditions 
of Theorem 3.2.7 are satisfied. 

It is possible to replace any product of sums expression of the 
form given in Corollary 3.2.5 by an equivalent expression in a form 


which will be useful in Section 3.4. 
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Theorem 3.2.9 An expression of the form 


k=1 iA, j6B, 


with A, and BL subsets of D, describes the same characteristic functions 


as the expression a given by 
£ : (x' + x_) 
- x x 
RER @@aR P 4 
where R is the family of binary relations on D such that REQ iff 
m 
RE (VU A.) x ( wy BL) and Rf) (A, Xx B,) is a singleton for k = 1,2,...m. 
k=1 k=1 


Proof: Rewrite each factor of the form 


eee ew es 


x 
i / L 
in the product, duplicating terms as necessary to obtain a factor of the 


form 


é. x! +x.) 
(A XB OF 


Then multiply all the resulting factors to yield 


» Ae ue + x) 


REG (p,q)eR 


where WN is the family of binary relations described in the statement of 


the theorem. 
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Example 3.2.10 The expression 
a7 1 i] 
E= @g tx; +x) &) +x, +x3) &y +x, +x.) 


is of the form 


TT Ghee ee. 
E — it Xi + ; 4 / 


k=l i€A, je, 


i = = = } = } = f : = f , 
with Ay {0,1}, Ay {2}, Ay (3), By (21, B {1,3), and B 1,4°. 
Rewriting the factors of E gives 


[ (egtx,) + (xj +x) ] [ (x54, ) + (xi 43, ) | [ (ryt, ) + Grjtx, )] 


Multiplying out, we get 
t = t T ' 1 t 
(xp) (xy tay) Cyt 4. Gr Hey) Ceyteey ) (xg tx,,) 
which is an expression of the form 


A a 
E> ¢ x’ + x) 
2) q 


REQ (p, gER 
where Gis the family of relations 


CAO 2s C25 De Cas N25: eh Cae)? 
£052) 5 2, 3)5 CB,491y (052) 5 23) Ose), 
(1,2), (2715, (3,1)°, enya eS (epee (3,4)), 


i125 (253) 5. Wy 1)t (2) Cea 8) ys Osa) 
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By a construction similar to that used in Theorem 3.2.8, the 
binary relations R in ® can be replaced by irreflexive and intransi- 
tive relations R; this is because the "reflexive and transitive parts" 
of R are redundant. Such a replacement will result in a reduction in 
the size of the expression f, It is not obvious that each R in R 
is antisymmetric, however; Theorem 3.2.8 does not apply because 
the expressions ER do not individually describe the entire set of 
output assignments. Moreover, a considerably smaller family of 
relations could be constructed than that arising from the procedure 
used in the proof; for example the proof procedure would rewrite 


(x, +x, +x, +x, ) as the redundant expression 


(xj +x,) + (x) +x, ) + (x5 4X3) + (x, +x, ) 


rather than the more compact expression 


(x) +X) + (xytx,) 


These two peculiarities of the theorem are related; Theorem 3.4.17 
will demonstrate that the redundancy in the family {Q will allow i 
to be reduced to a family of covering relations; the members of R 
whose reflexive transitive closure is not antisymmetric can be dis- 
carded. It will follow from this and other considerations in Section 
3.4 that the set of zero-one valued assignments at the output of any 


comparator network can be characterfzed by a family of partial orders. 
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3.3. Injective output assignments 

In contrast to the zero~one valued case, it is easily shown that 
C(I_), the set of injective assignments that can appear at the output 
of a comparator network, can be characterized by a set of partial 


orders. 
Theorem 3.3.1 For any comparator network C, 


cq1)e= U 
. pep =P 


where P is a (finite) family of partial orders P. 


Proof: Let P = {PI(P is a total order on D) A (Sf € c(I_)) (f€1,,)} 


Since D is a finite set, Pf is finite as well, and certainly 


cr)s U 1 
= pp PF 


Now let f' be an element of I, for some P € P, so that for all x and 

y in D, xPy > f£'(x) S f'(y). Now P is in P by virtue of the existence 
of an assignment f in c(I_) such that xPy > f(x) s f(y). Since f is 
injective and P is total, f(x) < f(y) = xPy, so that f(x) $ f(y) > 
f'(x) < f'(y). Finally, to show f' € c(I_); let T be a permutation on 
' 


D such that C(T-f) = f£; it is easily verified that C(1-f') = f' using 


Theorem 2.1.4. 


Theorem 3.3.3 will show that it is in general unnecessary to require 
that every member of P be total. It will be useful to prove the following 


important theorem first. 
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Theorem 3.3.2 If P, and P 


1 are partial orders, then P, © P, © 


2 1 2 


Proof: (>) if Py € Pos then xP > xP oy for all x, y € D. By 


definition of re 5 if £-¢ I then xP,y > f(x) S f(y) and therefore 
2 


2 
xPLY => f(x) S f(y), i.e. £ E Ip . (€) Let Py $F Py, 80 that there 

1 
exist elements a and b in D with aP,b and 7 (CaPyb). Let T be a total 


order containing P, Such that bTa, i.e. any total order containing the 


2 
partial order obtained by taking the transitive closure of the set 
Py U{(b,a)}. If fF € I, then xPoy => xTy > £(x) < f(y) and f € T ‘ 

2 


but since bTa, f(b) < f(a) and f ¢ - because f is injective. 
1 


Theorem 3.3.3 If I is a set of injective assignments satisfying 


for a family of partial orders P and if P' =P, then I = Th iff 


every total order contain P' also contains some P € P, 


Proof: () If I= To and P' © T for some total order T, then 


I, SI 


7 p! by Theorem 3.3.2 and hence Ih SI. If £ is any element 


of In f£ € I implies f € Ib for some P, and for all x and y, xPy > 
f(x) <= f(y). Since f is injective and T is total, f(x) = f(y) > 
xTy, so P&T, 

(©) Certainly I & Ip, since P' © Pp for every PEP. If £E Ip 


then let T be the total order defined by f, i.e. the total order 


with f € Ip, It is easy to show that P' © T. But by hypothesis, 
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P ©£T for some P ¢ P. This implies that f € Th = © I and since f was 


arbitrary, Ip! = Le 


Theorem 3.3.3 states that some subsets of the family ® of total orders 
discussed in Theorem 3.3.1 may be describable by intersections over 
those subsets, thereby giving a smaller family of partial orders. 

It remains to consider the effect of a comparator on a set I of 


injective assignments. 


Theorem 3.3.4 For any partial order P the comparator <i,j> transforms 
I into the set 
A 
- l 
I, Ip J Ib 


where Py is the smallest partial order containing P and (i,j), P, is 


the smallest partial order containing whe. and (i,j), and 7 is 


the permutation (ij). 


Proof: Let D = {0,1,...,n-1} and let I, = Ly U Gp» with 


P 
ee | £(4) < £(4)) 
G,=(f£€1, | £44) = £(05)} 


If jPi, then L, is empty; otherwise let Py be the smallest partial order 


P 

containing P and (i,j). Certainly P & Py so that I, S I: Since iPjj, 
1 

satisfies f(i) = f(j), sol, G&L, Now if f € L, then 


1 Fae 


every f in I, 


nhere exists a total order T with f < I, P ST, and ifj. Since at is the 
+ 
smallest partial order satisfying P & PL and iPj, Py © T and f £1, & tS 
4 


Therefore L, = I, . The comparator <i,j> has no effect on any element 
under the comparator is L, = Tf, . 
Tr iP} then C, is empty; otherwise, let Py be the smallest order 


fos -1 7 He ikns | . - 71 : 
containing 7 “*Pe™ and (i,4). Certainly P, 5 7 °.P.T, so that I, = 


en th eet th 2 tos eee 
Lo : Now CO = f'.f © Gor is precisely the same set as 
Tm oP, : : 
fet 1 left) < PCR) because 
Tr “se Pewt 
Joe ae E berneres cutis! yak aga. A 
fev .G © (xPy = FCT xy) & FOTiy))) 
P 3 2 ai Cd 
A EITG)) ® FOGG) 
pay ena ; 
a fx3P7 “Cy) = Flex) 8 £Cy)) 
fe ES SE) 

, oe aol Aea Aes Se tte: Ae, erat . 
Since every element 0} Up satisfies fF(i) < ff), I, <7 -G.. Select 
2 ae) 1 
pa areccraret i 4 oe > . 2 he oe aa Ae 
an £& “G, and let. T se the total order with £ ¢ Line Now 7 "*P.7 & r 


and iTi; since P., is the smaliest total order satisfying these conditions, 


Pp, ©Tand f € 7,2 i. . Vherefore -G, = 1, . The comparator sc Oe ta 


i) 

-j 
io 
rg 


mY ae 1 , P - 
transforms every element f in G, into 7 “+f, so that the image of G 


P 


under “i,j> is I. 


Putting the two images together, the comparator transtorms I, to 


Gerollary 3.3.5 the comparator <3 .i> catorms the 


in 
© 
a 
1o) 
rh 
te 
3 

o. 
149) 
Q 
fon 
tee 
< 
ie?) 


assignments 
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into the set 


where ae = (Pp, | ap € P(e, is the smallest partial order containing P 
and (i,j), Py = (P,| (ae € P)(P, is the smallest partial order con- 


taining leper and (i,j))}, and T is the permutation (ij). 


An example is in order. 


Example 3.3.6 Consider the comparator network <1,2> + <3,4>- <1,3>° 


<2,4> ° <2,3>. The family of partial orders P with C(I_) = UJ I 
7 PEP 


is given below for each stage in the network. For each comparator 


P 


in the network and for each P € Ps the partial orders Py and Po 


are given, and the next family P is of course the set consisting 


i+l 


of all Py and P, arising from partial orders P in the preceding family 
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&——# 
oO of 
8 
oy st 
_—* ? 
oO Nt 
Au re) 
-—_—* 
ro fan 
Hi 
xy 
Ce 


<1,3>: 


none 


mol oO xt 
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Notice that there is no partial order Py arising from the partial 


1 
order : and the comparator <2,3>, and that 
4 
ee: 
- P 
P 
PEP, 


cannot be expressed as Tp for any partial order P'. Also, the total 


orders 


Pm WH 


via the criterion of Theorem 3.3.3 or merely by observing that 


1 I I 1 
1 1 
<S: S 3.3 a. Ss 2 3 
2 2 i 
4 4 4 4 


In section 3.4, the notion of a lattice of partial orders on a set 
will be introduced. This notion will help elucidate the connection 


between zero-one valued assignments and injective assignments. 


3.4 The lattice of partial orders 

In sections 3.2 and 3.3, two techniques for characterizing network 
outputs were developed which have many similar features. In both cases 
for example, the effect of a comparator on the output set is reflected 
in the characterization by the formativun of a union, and when certain 


conditions are met the characterization can be reduced to a single 


occurring after comparator <2,4> could have been eliminated 


3 
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partial order. The lattice of partial orders on a domain is a convenient 


vehicle for exploring this similarity further. 


Definiton 3.4.1 Let 95 denote the set of all partial orders on the set D 


together with the relation DXD = D. CO 
The proof of the next theorem is straightforward. 


Theorem 3.4.2 The set 05? ordered by ©, forms a lattice with respect to 
the operations of set intersection and supremum, where the supremum 


operation V is defined in the usual way: 


Vv =f S < O 
Bee, (Pe 0! P, © PAP, <P} 


2 


Figure 3.4.1 depicts the lattice 9 ho) The lattice 05 is not 
> 3 
modular, and therefore not distributive, for domains of more than two 
elements. However 05 is useful because of Theorem 3.3.2 and the 


following result. 


Theorem 3.4.3 If P, and P, are partial orders, then P, & P, @ Z5 S 


1 2 1 2 2 
fee 
Proof: (>) Let Py S P, with g € coe Then (Vx, yeD) (xP,y > xPLy A 
xPoy ~ g(x) $ g(y)), so g € 2p and oe, c a (€) Let Zp, S 2p? 


and suppose x and y are such that xPLY but — (xPoy). Then let 


the assignment g be defined by 


1 if xP,w 
gw) = 


Figure 3.4.1 


(O42) 


oe 
rie 
No 


The lattice 0 


(0,1, 2) 
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Now g(x) = 1 and g(y) = 0, so g ¢ Z, + Since Z g€Z 


P ‘ 2p . P 

1 2 1 2 
implying that for some a and b in D, aPob, g(a) = 1, and g(b) = 0. 
By definition of g, xPa, so by transitivity of Pos xPpb and g(b) 


= 1, a contradiction. 


Theorems 3.3.2 and 3.4.3 state that the assignment functions 
I and Z are monotone decreasing functions from the lattice of 


partial orders 0. to the power sets of the injective and zero-one 


D2 


valued assignments respectively. (Setting Ey 1s dand Z, = 
D 
reeoyae cay?) is consistent not only with the definitions but also 


with these theorems.) The next theorem follows from Theorems 


3.3.2 and 3.4.3. 


Theorem 3.4.4 


(a) I =I, NI and 
P,VP, Py P,? 
get 
(b) Z = Z Nz if P, VP, #D 
PVP, Py P, i! 2 
Proof: (a) (injective case) Let P, be the set of pairs (x,y) 


3 


consistent with every assignment in both qr and I,5 more precisely, 


let P, = { (x,y) | (VE € Ip qn Ip ) (f(x) = f(y))}. It is readily 
1 2 


verified that P, is a partial order. Moreover, I ie eee — ae Se 
3 PL Po Ps 
for if f € I, n I, and xPy, then f(x) < f(y) by definition of P 
1 2 
Now Py S Pos for if xPyY; then by definition of r > £(x) = f(y) 
1 
for every f € Ls and hence for every f € I, a] I, 3 similarly, 


1 1 2 


3° 


61 


P, © P,. It follows that I, =I, and I, © 1, , so that I, ©&I 
2 3 P3 Py P3 Po 3 1 


NI and I. =I, ATL. It remains only to show that P = P, V P 
P P P P 

2 3 1 2 3 

Since Pi S P., and P, — P have already been proved, let Py be such that 


P,©£P, and P,©&P. Then I, SI and I, ~I1,, whence I, SI 
4 PA Py PA = Py Py Py 


n = ¢ 
I, I, and P, Pye 


(b) (zero-one case) Let P, = { (x,y) | (Ve E Zp al Zp \(£(x) = £E(y))} 
1 2 


Now P, is certainly reflexive and transitive, with Zp q Z, SZ, . 


1 2 3 
Tf Py is not antisymmetric then for some x and y in D, x #y but 


f(x) = f(y) for all f in Zp al Zp . This can only happen if xPLy and 
1 2 


x and xPoy3 in either event, Py Vv P, = D, The remainder 


of the proof parallels the proof for the injective case. 


3 


yP,x or yPy 


Theorem 3.4.4 suggests that sets of partial orders exhibiting 


closure properties under supremum may be useful. 


Definition 3.4.5 A subset F of 05 is a filter of 05 if, for all PEF 
and all QE 05° PVQEF. Alternatively, F is a filter if, whenever 


P is in F and P &Q, then Q is in F. 
Example 3.4.6 The sets 


; 1 p72 2 1 ‘ 
wy {1 fe (0,1,2} 
0 , $0 0 


> > 
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1 72 2 2 42 91 , 
UATE Eo 
o ,4#0 1, 60, 41, 40 


° 


0 1 92 0 O pl 92 90 70 41 91 5 
“1 / ra Ny {1 {2 fh fo {2 {0,1,2} 
2 , % ,41 2, 2 , bo, $1, 42, #2, 40 


3 3 


are all filters of the lattice 0 shown in Figure 3.4.1 


(0,1, 2} 


Definition 3.4.7 If IL is a set of injective assignments, F(I) = 


{PE 0,| Ib £1}; if Z is a set of zero-one valued assignments, 


F(z) ={P€ 0,12, S 7), 


Theorem 3.4.8 For any set of injective assignments I, F(I) is 
a filter. Similarly, for any set of zero~one valued assignments 


Z, F(Z) is a filter. 


: * (aa oma Gq 
Proof: Let P € F(I) and QE 0,. Since PS PV Q, Tovg ~ tp =F 


so P VQ €F(I). The proof for Z is similar. 


The set of generators of a filter is merely its set of minimal 


elements. 


Definition 3.4.9 The set of generators of a filter F is the set 
c(F) = (PC FI(VQE FI(QSP>Q=P)}. 
If G(F) is a singleton {P}, then F is said to be principal. 


The principal filter generated by P is written (P). 
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The connection will now be made between filters and sets of output 
assignments. It will be shown that for any comparator network C on D, 


czi_)= U p 
= PEF(C(I_)) 


C(Z_) = U Zp 
PEF (C(Z_)) 


The injective case is easily resolved; Theorem 3.3.1 guarantees that 


Cys U1, 
PEP 
for some family of partial orders P. Certainly P & F(C(I_),; and since 


Pee F(G)) TS es 


C(I_) = 12 oe 
PEF (C(I_)) 


The situation for zero-one valued assignments is not so simple. 
First note that the set of zero~one valued assignments C(Z_) that 
can appear at the output of a comparator network C can be described 
in terms of C(I_). This is by virtue of Theorem 3.1.3 and because 
the set of all zero~one valued assignments on D is just the set of 


thresholds of the set of all injective assignments on D. Hence 
= = uh 
c(z_) = &(c(I_)) = Jt 9C1,) 


for some family of partial orders ©, The next theorem relates Ip and 
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Theorem 3.4.10 If P is a partial order, (e,) = Zp 
Proof: Let g € 8(1,); so that g € 9(£) for some f € Th If f(x) = 
f(y) then g(x) © g(y); since f € Ips xPy > £(x) = f(y) and g € 25 
Conversely, let g € Zp» and without loss of generality let the range 
of the assignments in Ib be the integers. Certainly I, contains some 
assignment f with range {0,1,2,...n-1} (where D has n elements) so let 
h be the assignment defined by h(x) = f(x) + n.g(x). Now h is injective, 
for if h(x) = h(y) then h(x) = h(y) (mod n) so f(x) = f(y), implying 


X = y. Moreover, h is an element of I,, since xPy ~ f(x) = f(y) A g(x) 


Pp? 
Sg(y). Since g(x) = 1 iff h(x) 2n, g € 8(h) & 8(I,). Therefore 


g € 8 (Ip) eg € 25» 80 8(1,) = Z,. 
Theorem 3.4.10 and the remarks preceding it imply that 


c(z_) = U 2 


pep: = 


Since P & F(C(Z_)) obviously and P ¢ F(C(Z_)) = 25 © C(Z_), 


cZZ)= U 4, 
PEF (C(Z_)) 


The foregoing discussion is recapitulated in the following theorem. 
Theorem 3.4.11 For any comparator network C, 


Ce ot 
PEF(C(I_)) 
and 


C(Z_) = 8(c(T_>) = |) Zp 
PEF (C(Z_)) 
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The next theorem deals with the cases I = I, and Z = Z_. 
Theorem 3.4.12 F(I,) = F(Z.) = (P) 


Proof: Let Q€é F(I)5 then Ty S I, and P SO; 6OvO CP). FE-ONE CP). 


then P £ Q, Tg S I,, and Q € F(I,). The proof for Z 


p is entirely similar. 


As an immediate consequence of Theorems 3.4.11 and 3.4.12, we have 


Corollary 3.4.13. For any partial order P, 


Ul 
ra 


F(G(Z_)) = (P) ® C(Z_) 


i 
N 


F(C(Z_)) = (P) # C(Z_) 


Theorems 3.4.10 and 3.4.11 and Corollary 3.4.13 provide the raw 


material for Theorem 3.4.14. 


Theorem 3.4.14. For any comparator network C, if F(C(I_)) = (P) for 


some partial order P, then F(C(Z_)) = (P) as well. 


Proof: If F(C(I_)) = (P), then C(T_) = ie and C(2_) = 9(c(I_)) = 


8(I,) =*7, so that F(C(Z_)) = (P). 


Pp? 


The converse of this theorem is false, and the example below demonstrates. 


Example 3.4.15. For the network of Example 3.1.6, namely 
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the corresponding filter F(C(I_)) is 


ane fh 
oat f} 
aon et 


a a b 
b 

KR. ¥ 
edi yy d 


This filter is not principal; it is generated by the last two elements 


listed. F(8(C(I_))), on the other hand, is principal and is generated by 


Xl 


c d 


b 


In general, then, F(C(I_)) and F(8(C(I_))) are different filters 
with different generating sets. They are not totally unrelated; the 


filter F(8(C(I_))) always contains the filter F(C(I_)). 
Theorem 3.4.16 F(I) © F(8(L)) for any set of injective assignments I. 


Proof: If P € F(I) then I,, © I, implying Z, = 6(I,) © 6(I) and 


P P 


Pe ECC). 


When F(C(I_)) is principal, this fact can be determined by applying 


Theorem 3.3.3 to any family of partial orders P such that 


c(I_)= U f 
Per 


P 


= 


67 


If F(C(I_)) is not principal, it is not clear how to obtain the 
generators of the filter without first constructing the entire 
filter. The generators of F(C(Z_)) may be obtained in an easier 


fashion from any product of sums expression for Z. 


Theorem 3.4.17 Let E be a product of sums expressions for the 
characteristic function of C(Z_) in the form specified by Corollary 


3.2.5, so that 


= : [ x, |' ( = “4 


A 
Let E be the equivalent expression defined in Theorem 3.2.9, so that 


A 2. 

E = £ (x '+x_) 

REQ (p,qyeR P 4 

where R is a family of binary relations R with R NCA, x BL) a singleton 


for k = 1,2,...m. Then every member of F(C(Z_) contains some REA, 


Proof: Let P be a member of F(C(Z_)), so that 2, = C(Z_). Then any 


P 
expression describing the characteristic function for Zp» and in parti- 
cular the expression Ep given by 


ED = | | (x, ' + x) 


(p,q) €P 


A 
implies E; that is, if E, evaluates to 1, so does p, It will be shown 


P 
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that PN (A, *B,) is nonempty for k = 1,2,...m, implying R © P 
for some R eke. Suppose P 1) (A, XB, ) is empty for some k. Let g 
be the assignment 
1if (da € A.) (aPw) 
go) 


0 else 


First, g © Z,; if this were not so, there would exist x and y such 


Pp 
that xPy, g(x) = 1, and g(y) = 0. But if g(x) = 1, aPx for some a € A.3 
by transitivity of P, aPy and g(y) = l,a contradiction. g(a) = 1 
for every a € A. by definition of g, but g(b) = 0 for every b € Bi 

if this were not so, then Pf) AL XB, would be nonempty. Now E, evalu- 
ated at g is clearly zero, since its <o term is zero, so p evaluated 


at g is zero, a contradiction of the fact that E,, implies ®. Hence 


P 
R = P for some R cQ, 


The statement of the theorem is much more cumbersome than its 


application in practice. 


Example 3.4.18 Consider the network shown below. 


os fo 


rh @O@ & a 
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One expression for the characteristic function of the zero-one valued 


outputs C(Z_) is 


E = (x 14%, ) (x4) (x +e.) (gt tx) 


1 t 1 t 1 
(xp tx ete) Optix) (xi tx) Oxitee) 


According to Theorem 3.4.16, any partial order in F(C(Z_)) must contain (a,b), 
(a,d),(a,e), (b,£), (c,£),(e,£) and one element from each of the sets 
{(d,b),(d,e)} and {(b,c),(e,c)}. That is, any partial order in F(C(Z_)) must 


contain one of the four partial orders 


Since none of these partial orders is contained in any other, they are 


\ 


the generators of F(C(Z_)). ia 


Note that if there is no partial order containing a relation 
RE RR then that R may be discarded for purposes of finding the 
generators of F(C(Z_)). This will occur if the expressions for 
C(Z_) gives rise to relations R whose transitive closure is not 


antisymmetric. An example is the expression 


E = (xi +x) (xp tx tx.) (x) 4x) 


which describes the outputs of the sorting network 
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albeit not minimally. It also may happen that for some R and R' in 
the smallest aanenad order containing R also contains R'; in this event 
R may be discarded. } 

The results of this chapter indicate two things: first, that 
zero-one valued assignments are usually more convenient than injective 
assignments as a tool for characterizing output behavior; and second, 
that sets of assignments described by single partial orders are parti- 
cularly simple to work with. Chapter 4 explores further the properties 


of sets of assignments described by single partial orders. 
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CHAPTER 4 


OUTPUTS CHARACTERIZED BY A PARTIAL ORDER 


4.1 Sorting Injective Assignments with respect to a Partial Order 


It is easy to show that for any partial order P on a finite domain 
there exists a comparator network such that all possible injective 
outputs of the network are sorted with respect to P; sorting with 
respect to any total order containing P will suffice. Perhaps not 
so obvious is the fact that for any partial order P there exists a 
comparator network such that c(1_), the set of possible injective 
outputs of the network, consists of exactly those assignments that 
are sorted with respect to P. A lemma will be useful for establishing 


this result. 


Lemma 4.1.1 Let P be a partial order on D with x and y elements of D 


such that — (xPy) and -— (yPx). Let the set X be 


X = {a € DlaPx An (aPy)} 


Now, X is nonempty since x € X, so let & be a P-least element of X. Next 


let the set Y be defined by 
Y = {b € DlyPb A - (aPb)} 
Y is nonempty because y € Y, so let B be a P-greatest element of Y. Then 


Py> the smallest partial order containing P and the ordered pair (0,8), 


is contained in both 
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we lL. 
Pos the smallest partial order containing 7 ~-P.™ and (0,8), 


where T is the permutation (@,8), and 


Pos the smallest partial order containing P and (x,y). 


For example, if P is the partial order 


0 

i 2 
we 

3 4 
mA 


with x = 4 and y = 1, then % = 2, 8 = 1, 


is 


and P., is 


WR is 


SA 
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(remember the “higher is smaller" convention for partial orders.) 


Proof: To show P = Fr, it suffices to show P & Py Let aPb. 


Case l. a=. Now b # B, because OP contradicts B € Y. Therefore 


BPb, and since OP4B, aP.b, i.e. aPob. 


Case 2, a= 8. Now b #4, because if BPA, then OPx and yPB would imply 
yPx. Since B is a greatest element of Y, either b = B or &Pb. In either 


event BP,b, i.e. aP,b. 


Case 3. a #4, a # B, b =. Then since 4 is a least element of X, aPy; 


and since yPB, aPf and aP,o, i.e. aP.b. 


Case 4. a #4, a#68, b= 8. Then aP,a and since aP,B, aP.B, i.e. aPob. 


Case 5. a#a,a#B, b#%, b # B. Then aPb implies aP,b. 
To show PL S P3> it suffices to show that OP, B. But since Px and yP8, 
aP,x and yP,B; since xP3Y> OP, 8B. 

Note that aP,B but — (4PB); in fact, it is not difficult to show 
that Py = P U {(Q,B)}, so that Py contains exactly one more ordered 


pair than does P. 


From this construction it is easy to see how to obtain any set of injec~ 


tive assignments of the form I, as the set of outputs C(I_) of some 


P 


comparator network; in fact, it is possible to construct a network 


that transforms any I, into Ty as long as I. contains [.,. 


P P Q 
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Theorem 4.1.2 If P and OQ are partial orders with P S Q then there 


exists a comparator network which transforms fn into [.. 
Proof: The proof is by induction on the number of ordered pairs in Q=P. 


Basis: TF Q@P is empty, then 9 =P, I. =T1 and a vacuous network 


QP? 


suffices. 


Induction Step: Suppose a comparator network exists to transform Th to 
Ty as long as 9-P contains n or fewer ordered pairs, and suppose ?P 
contains ntl ordered pairs, one of which is (x,y). Apply the comparator 


<a,B> determined by Lemma 4.1.1 to TD by Theorem 3.3.4, this comparator 


transforms I, into T, Gos , where P, is the smallest partial order 
: 


: 
containing P and (2,8), and P, is the smallest partial order containing 


De (RY and (N 6 me, : Dp Cp = ce 
(4B)*P+ (4B) and (97,8). iy Lemma 4.1.1, Py = P,, so re "By and I, 
is transformed by <a,2> into I, . Since (x,y) is a member of 9 and P= Q, 
1 


Q contains P,, the smallest vartial order containing P and (x,y). 
~) 


Since Lemma 4.1.1 ulso guarantees P, ss Ps, Py Oe Now since oP) B but 


“7 (2PB), OP, has u or fewer elements, so that by the induction hypothesis, 
T can be transformed to i. by some comparator network. [ft follows that 


1 < 


P 
<@,B> concatenated with this network transforms [,, into T O 


P Q° 


Repeated application of the induction step in the theorem will give 


rise to a comparator network that transtorms T, into tO and that contains 


£ 


as many comparators as there are ordered pairs in Q-P. In particular, 
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if P is the identity relation on D and Q is a total order, the resulting 
network will be a sorting network containing 6) comparators. Such a 
network is inefficient, but it has the interesting property that at any 
stage, the injective assignments that can appear (and, because of Theorem 
3.4.14, the zero-one valued assignments that can appear) are characterized 


by a single partial order. 


Example 4.1.3 The sorting network 


se) 


o 


conforms to the inductive construction of Theorem 4.1.2 for the sequence 
of partial orders 


a a 
a bed, b b &c ed , c wd , 


ane 


Lemma 4.1.1 and Theorem 4.1.2 are not the only ways to guarantee a 
single partial order at each stage; a lemma dual to lemma 4.1.1 can be 
established which guarantees that the partial orders Py and Py described 


in Theorem 3.3.4 satisfy Py & Pie An inductive argument similar to 
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Theorem 4.1.2 but employing either lemma in the induction step would 
give rise to a broader class of networks than those derivable from 
Theorem 4.1.2. 

P 


It is sometimes possible to transform Tp into Ty by sorting I 


with respect to a partial order S. 


Theorem 4.1.4 Let P and S be partial orders on D, and let C be a 
comparator network so that 


Lys 2O(L Te 


2. (VEE Ig) (C(£) = f) 


e 
3. c(I,) I, 


Then C(I,) = I, VI, = Liye. 


Proof: By statement 3, C maps I, into a subset of Th; by statement i, 
C maps Ib into a subset of Toe On the other hand, C maps Ib n Tg onto 


I, n I, by statement 2. Hence C maps I, onto I, nq Tos which is equal 


to I by Theorem 3.4.4. 


PVS 


[Gale and Karp] have developed a necessary and sufficient condition 
for statement 3 to hold when S is a partial order whose maximal chains 
are disjoint and C is a standard form network that sorts according to 
the maximal chains of S. Before stating Gale and Karp's result, a 


definition will be useful. 


Definition 4.1.5 Let P be a partial order on domain D. For any 


element x of D, the sets xP and Px are defined as follows: 


xP 


fy € p[xPy} 


Px ={y € pl yPx} 
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Theorem 4.1.6 [Gale and Karp] Let C be a standard form comparator 


network such that C(T_) = I,, where S is a partial order on D with 


S? 
maximal chains disjoint. Further, let P be a partial order on D. 


Then C transforms every element of I, into an element of - iff 


P 
1. S UP is antisymmetric; 
2. If xPy then for every set B © yS U Sy with [3 | = |sy| there 
exists a set A&=xS U Sx with la| = |sx| such that every 
element of A is P<less than some element of B. a 


{Liu] has extended this result by showing that if C is a 
comparator network satisfying the hypothesis of the theorem and if 
condition 1 of the theorem is satisfied, then c(I,) is a set I such 
that Q, the Taeceee partial order satisfying I © Io is equal to 
S V P', where P' is the partial order consisting of all those ordered 
pairs (x,y) from P that satisfy condition 2 of the theorem. It is 
readily shown that the largest partial order Q such that I © Ty 
is just A(F(I)), the intersection of all of the partial orders in 
the filter F(I). The key fact that makes this construction possible 
is the fact that S has disjoint maximal chains; if this were not 
the case, then there might exist two networks which have a different 
effect on I, even though both networks sort with respect to the 


P 


same partial order. 


“xample 4.1.7 


both sort rhe partial order S with ordering 


i 


+ + + a 


generalize She resuits ao: 


4 


Liu to deal with the 


he a oe “ al q an telly ie ee tet oat he Liwaae ye Caries ead A car} = z Tae pees 
case where oO Guses MOL Hawes Turi chawnus distoint without spectfving 
mere about MS Pe quater C that sorts with respect 
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4.2 Real-valued Assignments and Convexity 


In this section, we will consider assignments whose range is 
the set of real numbers. It will be appropriate to refer to such 
assignments as vectors in real n-dimensional coordinate space Rs 
One reason this is convenient is that if a comparator <i,j> on 
the domain D = {0,1,...n=-1} is applied to a vector in R”, then 
the effect of the comparator can be described by means of a hyper~ 


plane in Ree 


Definition 4.2.1. For any two distinct elements i and j in {1,2,...n}, 


let Hi, be defined by 


ve TL 
Hy, = (ve lv, v, = 0} 


Hy is certainly a hyperplane (i.e., an n-1 dimensional subspace) of 
Re By the projection theorem, any element u of R” can be written 
uniquely as a sum u = v + w, where v is an element of the hyperplane 
Hey and w is an element of ae (Recall that if H is a subspace 

of vector space V, a> is the set of vectors of V such that the inner 
product of any element of H and any element of H is zero). From the 


definition of Hy 5 eae is the subspace 


als n 
Ha | ={weER lw, tw, = 0 A (Yk) 


(k=iVk=jV wy, = 0) 


Now, an element u in R” lies on the positive side of Aa A | 20) 
or on the negative side of Hy, (uj-ty < 0) or possibly both; the side 


of the hyperplane on which u resides is determined by the sign of 


J} 


u,cu,. Notice also that if uscu, is positive, the comparator, <i,j-> 
J oot Jol : 


has no effect on u, whereas if u,-u, is negative, the comparator 
i 


4 
J 
<i,j> interchanges uy and uss Lf u is written u = vtw with v “~ ae 
j i 
ae ae U5 Rus 
and w © l.. , then clearly v. =v. = i oj and 
1! : 4 J ae we 
u,7U, u,7u, 
TS) i 
Ww. = = > WwW. = -i+ 
i 2 2 
If u lies on the positive side of H,,, the comparator transforms u = vtw 
} 14 I 
into u' = vtw; if u lies on the negative side of Hes the comparator 
§ ae 


transforms u = v+w into u' = v-w. Theorem 4.2.2 sums up these obser- 


vations. 
Theorem 4.2.2, Tf “by j> a comparator on the domain [1,2,...n° 
: ha ATE na aa - ne 
and u is any vector in Ro with u = veiw, v “ H,., and w*H » then 


“- . 


<i,j> transforms u into 


ul =v + (sign w,)w 


The transtormation pertormed by a comparator is nonlinear. In essence, 
the comparator <i,j° "reileccs" every vector u to the positive side of 
H,.- [t would seem plausible that a comparator network would at least 
transform the set Re into a convex set; the remainder of this section 


will consist of a proot that this is true if and only if the comparator 


network maps R onto the ser of 


with some partial 


order. 
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Theorem 4.2.3 The set A of real vectors that can appear at the output 


of a comparator network C is convex iff A = Ap for some partial order P. 
Proof: (€=) if A= Ap for some partial order P, i.e. if 


A= (u ER’, 5) (Pj > u, <u,)) 
then for any two elements u and u' in A and for any A, 0 <A S11, the 
vector Au + (1-A) u' is in A, since if LtPj, then u, s a and u; s us5 
since both ® and 1-\ are positive, Au, Ss as and (L-A uy s Coa. 
This means that Au; + (1-\)uy < ru, + (l-A)us, so Nu + (1-\)u! 
is an element of A. 
( =) Let A be a convex set, and let P be the set (1,5) | (Wu € A) (uj-uy 2 O)}.- 
P is obviously reflexive; P is antisymmetric because A contains 
injective assignments. P is transitive because if Fas 2 0 and 
u 


a 20, then u nu, 20, Thus P is a partial order. Now AS Ap» since 


k k 

iPj implies uy s u, for every u € A, so it remains to show that Ap =A. 
Now Ap and A are surely nonempty since A is the set of possible 

vectors at the output of C. In fact, A contains injective assignments; 


according to Theorem 3.3.1, the set I of injective assignments of A can 


be written 


where each T is a total order. It is also true that Ib the set of 
injective assignments in Ap» can be written 


io= UW fT 


P por T 


and since A © Ap I & Tp: Mor 
Lh & Ib and P = T for every T 
T ere this will imply =. =I 


P 
Let P&T with T te7 and 


& 


I 


T It with every component 


_th 
let the j smallest component 
total order T' er and let vy 


with every component v, a dist 
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eover, since I, = I for all T aul & 

aut. It will be shown that P © T > 

; Ly = Z, and finally Ap = A, 

let u be an assignment vector in 

u, a distinct power of 2. In particular 


of u be 2 j = 1,2,...n. Select any 


be an assignment vector in I, © I 


qT 


, n .th 
inct power of 2 , so that the j smallest 


gy GAT ke a eg 
component of vis 2" , j = 1,2,...n. 
By construction, u Ap7"A and v ¢ A; since Ap is convex, every 
vector w = Au + (1-\)v belongs to A, for all \ in the interval 0 = <= L 
but w belongs to A only Lor certain values of 4. Since A is convex, 


the collection of thes: 


\ 


for some Nos Cie: 


ae) 


letting Tdenote the total orde 


some small neighborhood a 


jv is not injective; if it were, 


forms an interval O SN- ro or O<XA ¥< No 


then 


yr such that x La, every vector within 
lsc would belong to [,,. Since this small 


neighborhood would inciud. both vectors tn LT and vectors in tpl by 
definition of Nos Dn woul: be a subset of both I and T-T, a contradiction. 
Therefore x, = = i,i with 1 # j. It will be argued that 
a : a 
this cannot occur for more than one such pair. 
. 1 . ‘ 4 : ra ox 
Suppose x, =x, and x, = x,, with i+ i, « # #, and (i,j) # [k,*). 
\ Me ke 

Then AAwu, + C1l"\,) v. ali bles jy, and Aju, + (1eA,)v, = aA,u, + 
Be Oy Se Oe Ge a ea o7%~ ~ “o's 
(l-rg)v Solving these equations Lor ey vields 
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Griev,) PES 
Se, ee 
0 ivgrvg) heart) (vgrv > (uymu, ) 
or 
(u,-u.) (u,-u, ) 
2 oe ae hk 
No lUwaev,) a (v o7v,) 
6) j i fk! 
whence 
Cg. reS) iv) 
i fiestas anes 
(uyru, ) (vynv,) 
(usu) 4 
Now either } —~—- | <1, su that 
(uy-u, ) 
K 
Pe (u_-u,) ~ 2 
BoP fee ee gh Gee 1 1 
ee Cy a 
(GAG) 4 
or eRe) | ~ 1, implivineg 
ae as 
ot _y ae ay oy A yf 
ee re 
22° See ep 
i iv “vi )] 
. . 4 ! 3 1 ‘ ° 4 
it remains to be shown that Lae ae lies outside 
L Vg", 


First, consider the case in which max (viaV,) 


case, it can be shown that 


these intervals. 


= max (vy,v,)- 
EP 4e 
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poo 235 20-2 
Ss 4 1 
2 2 
n n 


Since 


is less than 1 ter « = 3, 


and from the bounds previously found, 


(u,-u,) bye e 


Z£ ease 
(u p-uy. ee (v anv, ) 


Now suppose max(v,,v,) #4 max(v,,v,_). 


) 


Then it can be shawn that 


A 


LE max(v ee < max (Vv ,V).) 
be "k 


IW 


a¥ max fy sp mae fs wy 
LP Max ( Voy g We MAKLV_75Vy J 
“ok 
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Since 
2 n2 Bi 2 2 
2-2 ag gf aot “8 
° = 2 . 
eee) no -n .n oo ae 2n n 
2 -~2 2° =-2°2 -2 °° +4+2°2 
is greater than 1 for n 2 3, 
a n 2 ae 
eee yt Ore? at 5 Bose 
2 n 2 2 
9m aon “1 2-2 2-2 on ~n_pn 
and once again 
(u,-u,) | (v cv.) 
(u,-u,) (vgrv,) 
so that 
(u,-u, ) (v,7v.) 
ii r (ee 
Cai) (vary) 


The foregoing argument establishes that x lies on exactly one hyperplane 


H As a result, there exists an €-neighborhood N-(x) of x such that for all 


sO i 
y in this neighborhood, y is in A if the signs of ¥i7%5 and rey agree, and 


y is in ApvA if not. Without loss of generality, let ve <0, so that for 


i 
if y, < “Ai >y.. 

ally € No(x), y €Aif yy y; and y € ApvA if yy y; Since there 

exist vectors y satisfying this latter condition, iPj is false; by definition 


of P, there exists a z € A_ so that cg Zs A diagram of the situation is 


shown in Figure 4.2.1 


ae "3 


Figure 4.2.) Situation resulting from the assumption I-I # & 


P 


A contradiction will pe reached by 


ther there exists ay “ A so 


that some point y' on the line segment jotnins vy and = through x does 
not lie in A. Since A is convex, this is impossitile. so the selection 


of u was impossible and P fom PT Ce, i.e. fo = TL. Te remains 


only to find y and y'. 


Let & denote the distance between x and z, i.e. 


[2 
ao 2 
a = | xez Il = | (x,72% ) 
| i=l 
and let : 
y= (1+ 3G. \x + ( oa yz 
Now 


[| x-y |] 


ll 
I 
= 


E | 
Cae RE See: | 


so y € N-(x). Since x,=x, and z, ae 


i 4? 
hand, 
y' = (1 - On dx + ( oy 2 


satisfies 


(= )z2 
20 ) 
so that y' © N-(x); since x, and z, > Bas 
x € 
yy Os oe. ah ae 2 
Oe ae 
= Se a Se 
= ; S Zu 
(1 + 3q) Cb a 
c 
Cos 35) is 
= = v+o7 = = Z 
G+e) arg 


‘20 


IT =x] 


=a 
2 


y. < y and y © A. On the 


other 
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and y' is a convex combination of y and z, contradicting the convexity 


of A. 

It has been shown that if A is convex, I = Toe By Theorems 3.4.11 
and 3.4.10, z = 9(I) = (ES) = Zs and it remains to show A, SA. Note 
first that for any real number r, the vector giel. defined by inl =r 


for i = 1,2,...n, belongs to A. Also, A is closed under positive com~ 


bination; that is, for any vectors u, v € A and any positive real 


numbers r and s,w = ru+sv € A. This result is based on the fact that 
( el Jw = (=—)u + (—)v is in A by convexity, and since rts > 0 
r+s r+s r+s , : 


Theorem 2.1.3 guarantees w € A. Now let x € Ap Clearly 9(x) © Z so 


Pp’ 


8(x) S A. w can be written 


[n] 


w= [min(w, |t=1,2,...0)] 


. 
+ Ze | mntng gett mentee) | 
ii i “i 
zew 
z#0",1" 
| ms | 
i i= 7 3 > = 
Now [min{w, |i 1,2,...n} ] € A. Also min{w, |z, 1} max{w, Z 5 0} 


because z € 8(w). Since w has been written as a positive combination 


of elements of A, w € A and Ap SA. Therefore A, = A. Oo 
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CHAPTER 5 


CONCLUSIONS 


The analysis of sorting networks appears to be a complex and difficult 


subject. The results of this thesis reflect the kinds of complexity 
that occur; most often, the problem is one of succinct characterization 
of the phenomenon to be studied. For example, the Boolean expressions 
of Section 3.2 are quite compact in contrast to the partial order 
theoretic characterizations of output behavior found in Section 3.3, 
but in fact these expressions are not nearly as economical as one might 
desire for a domain of eight elements, say. 

Another source of difficulty is the seeming lack of algebraic 
structure on the objects of interest: compositions of comparators, 
sets of assignments, and so forth. There is at least one significant 
exception to this generalization, however. When the set of injective 
assignments that can appear at the output of a comparator network is 
precisely the set of injective assignments consistent with a single 
partial order, then many structural regularities occur. For example, 
it can be shown that the number of injective assignments consistent 
with a partial order P is a multiple of the number of symmetries of P - 
i.e., the number of permutations T on D such that whip = P, Other 
examples of structural regularity arising from the single partial order 


case may be found in Section 3.4 and in Chapter 4. 
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Aside from the difficulties, there are two interesting phenomena 
that deserve mention. The first is that as a tool for network design, 
the Boolean expression characterization for sets of zero-one valued 
output assignments is much more satisfactory than the partial order 
theoretic characterization for injective output assignments. The 
manipulations required are simpler to perform, and it is easier to 
determine a minimal Boolean expression for a particular set of zero~ 
one valued assignments than to determine a minimal family of partial 
orders by means of Theorem 3.3.3 in the injective case. Also, 
Theorem 3.4.14 and Example 3.4.15 indicate that sets of zero-one 
valued network output assignments are characterized by single partial 
orders more frequently than the injective output assignments are. 

The other phenomenon is that in establishing properties of 
sorting networks, it is often useful to go back and forth from in- 
jective assignments to zero-one valued assignments. This kind of 
interplay occurs in Section 3.4 and especially in the proof of 
Theorem 4.2.3. This phenomenon is probably due to the fact that 
for any injective assignment there is a unique total order with 
which it is consistent, so that the relationship between a zero-one 
valued assignment and a partial order with which it is consistent 
is sometimes best explored by finding an injective assignment which 
has the zero-one valued assignment as a threshold. 

Insofar as directions for future research are concerned, it is 


probably fair to say that no direction seems particularly promising 
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for a resolution of the outstanding open problem about sorting networks, 
namely, how many comparators suffice to construct one. It would be 
desirable to know more about the kinds of sets of assignments that can 
occur as network outputs and the kinds of sets of assignments that 
can be assignments that are sorted by a network, but it is likely 
that a successful resolution of the question of the number of 
comparators will be based on considerations as yet unexplored. 

The possibility of new techniques that will be useful for designing 
good networks for particular domain sizes is somewhat more hopeful. 
The results of Section 3.2 provide a way of exploring this area in 
an efficient manner. The idea is to start with the set Z and apply 
comparators in sequence to obtain sets of zero-one valued assignments 
that are progressively "closer" to a sorted set of zero-one valued 
assignments. At each stage in the construction, the degree of "closeness" 
tg the sorted set could be evaluated by the number of assignments in 
the set, the form of the partial orders that generate its filter, and 
so forth. It would probably be desirable to use product of sums 
expressions for an evaluation of the "state of the sort" and sum of 
products expressions for evaluating the effect of a comparator on the 


current set of assignments because of Theorem 3.2.3. 
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